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1 . INTRODUCTION 

Currently  the  U.S.  Amy  is  developing  a system  for  the  acquisition 
and  tracking  of  military  targets  from  helicopters.  The  Army  is  also 
developing  missiles  which  are  capable  of  locking  on  to  the  target  prior 

I 

to  launch  and  then  of  homing  in  on  the  target  during  flight.  To  accom- 
plish this  task  some  means  must  be  provided  for  "handing  off"  the  target 
from  the  precision  pointing  and  tracking  system  (PTS)  to  the  missile 
seeker  in  minimum  time.  The  PTS  can  either  be  a high  resolution  day 
TV  system  or  a forward  looking  infrared  (FLIR)  system.  The  missile, 
which  is  usually  lower  resolution  because  of  size  and  costs  constraints, 
can  be  a day  TV  or  an  infrared  imaging  seeker  (IRIS)  system.  Therefore 
target  hand-off  must  be  accomplished  between  two  similar  sensors  (e.g., 
between  the  PTS  high  resolution  day  TV  and  the  missile  low  resolution 
day  TV  system)  or  between  two  dissimilar  sensors  (e.g.,  the  PTS  high 
resolution  TV  and  an  IRIS).  In  order  to  study  the  sensitive  parameters 
in  existing  techniques  to  accomplish  target  hand-off  in  the  above  two 
cases,  the  U.S.  Army  Research  and  Development  Command,  Huntsville,  Alabama, 
let  a contract  with  the  Engineering  Experiment  Station,  Auburn  University, 

Auburn,  Alabama.  This  report  presents  the  results  of  that  effort. 

A.  Scope  of  Work 

The  purpose  of  this  study  was  to  determine  the  optimal  gradient 
matrix  thresholds  for  bl -level  and  trl -level  correlation  between  two  TV 
systems  and  between  a TV  and  IRIS  system.  This  analysis  required 
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1)  Establishing  3x3  gradient  matrices  utilizing  the  SOBEL 
edge  detection  concept  for  eight  (8)  IR  and  TV  scenes. 

The  digitized  images  were  supplied  by  the  government  on 
standard  nine  track  magnetic  tape. 

2)  Performing  an  analysis  to  determine  optimal  threshold 
values  for  generation  of  bi-level  and  tri-level  correla- 
tion matrices  which  maximize  the  Image  correlation. 

3)  Performing  simulations  to  verify  the  results  in  paragraph 
2 above. 

B.  Organization  of  Report 

All  of  the  work  outlined  in  the  Scope  of  Work  has  been  completed 
and  is  documented  in  this  final  report.  Task  1 in  the  Scope  of  Work 
was  completed  and  the  results  are  stored  in  computer  memory  on  Disk 
and  in  computer  print-outs.  The  data  is  too  voluminous  for  inclusion 
In  this  final  report.  Tasks  2 and  3 are  documented  in  Chapter  2.  The 
optimal  threshold  problem  for  bi -level  and  tri -level  correlation  matrices 
Is  similar  for  both  the  TV-to-TV  and  the  TV-to-IR  correlation.  Because 
of  the  large  amount  of  data  generated  and  the  limited  amount  of  computer 
time  available  on  this  contract,  the  TV-to-TV  correlation  only  was  simu- 
lated and  results  extrapolated  to  the  TV-to-IR  case.  Simulations  using 
reference  sizes  of  32  x 32,  16  x 16  and  8x8  were  run  for  all  cases. 
However,  because  the  8 x 8 references  did  not  lead  to  correct  correla- 
tion, only  the  32  x 32  and  16  x 16  reference  array  results  are  presented 
in  this  report. 


I 


Chapter  3 summarizes  the  results  and  conclusions  of  the  work. 
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2.  CORRELATION  THRESHOLD  TECHNIQUES  AND  SIMULATION 

In  this  chapter,  three  preprocessing  algorithms  used  to  transform 
digital  images  to  a binary  form  are  presented.  The  spatial  resolution 
of  High  Resolution  (HR)  Video  is  reduced  to  that  of  Low  Resolution  (LR) 
Video,  before  the  HR-Video  is  transformed  to  the  binary  form.  The  dif- 
ference in  resolution  is  caused  by  the  differing  fields  of  view,  num- 
ber of  TV  lines  per  frame,  frame  rate,  aspect  ratio  and  sampling  rate 
of  the  two  TV  systems.  The  vertical  scale  factor,  Wy,  and  horizontal 
scale  factor,  W^,  were  previously  calculated  to  be  3.32  and  6.64, 
respectively.  Preprocessed  HR  and  LR  videos  in  binary  form  are  input  to 
the  correlation  process  and  the  results  are  tabulated.  The  algorithms 
discussed  in  this  chapter  are  applicable  to  a correlator  system  in 
which  both  images 'are  acquired  with  sensors  sensitive  in  the  visual 
spectrum. 

For  Scene  3 (jeep  in  front  of  the  fence),  the  method  of  choosing 
the  reference  array  from  preprocessed  HR-Video,  the  technique  for 
generating  various  correlation  surfaces  and  the  technique  for  calcula- 
ting the  expected  peak  locations  in  the  correlation  surfaces  are  illus- 
trated. Final  results  are  tabulated  for  all  scenes. 

A.  Correlation  Using  Line  Average  Quantizer 

Consider  a single  line  of  video  as  shown  In  Figure  1.  The  pixel 

to  be  quantized  is  X(i,j).  The  line  average  quantizer  quantizes  the 

points  of  the  selected  Input  array  by  calculating  the  average  value  of 

a specified  number  of  previous  pixels  of  the  same  line.  The 
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quantization  threshold  is  then  this  average  value.  Equation  1 describes 

the  average  value  calculation  where  L is  the  average  Value  Sample  Length. 

, L 

X(i,j)  = f £ X(i,  j - J + 1)  (1) 

L J=1 


Equation  2 gives  the  quantization  process 


*„(i.  j)  - <J 


X(i,  J)  ii(i,  j) 

X ( i , j)  < X(i,  j)  . 


(2) 


where  Xq(i,  j)  is  the  quantized  pixel.  This  process  continues  until  all 
pixels  in  the  input  array  are  quantized.  As  can  be  seen  from  Figure  1, 
the  first  (L  - 1)  pixels  of  each  line  will  be  quantized  incorrectly  and 


Figure  1.  Layout  for  quantization  based  on  a line  average. 


must  be  ignored  in  the  correlation  process.  If  the  original  input  array 
is  of  size  N x M,  then  the  quantized  array  will  contain  N x (M-L+l) 
valid  points. 

1.  High  Resolution  Video  Preprocessing 

As  mentioned  earlier.  Scene  3 (jeep  in  front  of  the  fence)  is 
used  to  illustrate  the  preprocessing  and  correlation  process.  The  size 
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of  the  unprocessed  h:  :h  resolution  video  (UHRV)  is  240  x 512.  When  the 
resolution  of  HR-Video  is  reduced  to  that  of  LR-Video  by  using  the  Wu 
and  Wy  scale  factors,  the  size  of  the  reduced  high  resolution  video 
(RHRV)  is  72  x 77.  The  RHRV  is  then  quantized  line  by  line  using  a 
line  average  quantizer  of  length  11,  to  obtain  the  processed  high  reso- 
lution video  (PHRV).  A reference  array  (REFV)  of  size  32  x 32,  which 
includes  the  jeep,  is  selected  from  PHRV.  Figure  2 shows  the  position 
of  PHRV  and  REFV  in  RHRV. 

For  better  correlation  results,  it  is  necessary  to  have  an  equal 
number  of  'ones'  and  'zeros'  in  REFV.  If,  in  the  REFV,  the  number  of 
ones  is  not  equal  to  the  number  of  zeros  ±5%,  the  quantization  threshold 
is  changed,  and  RHRV  is  requantized.  This  process  is  repeated  until 
the  number  of  'ones'  in  REFV  is  equal  to  the  number  of  'zeros'  within 
the  limit  of  ±5%  error.  The  modified  quantization  process  is  described 
by  Equation  3. 


(i  s rl  ; X(i,  j)  > X(i,  j)  + DELTA 
q 1 * l0  ; X(i , j)  < J(U  j)  + DELTA 


Obviously  DELTA  can  be  positive  or  negative  depending  on  whether  the 

number  of  ones  is  greater  than  or  less  than  the  number  of  zeros  in  REFV, 

* 

respectively. 

2.  Low  Resolution  Video  Preprocessing 

The  size  of  the  unprocessed  low  resolution  video  is  240  x 512.  In 
order  to  save  computation  time  and  memory  requirement*,  only  that  portion 
of  the  LR  Video  as  described  below  is  preprocessed  and  used  as  input  to 
the  correlation  process.  A segment  of  size  120  x 240  including  the  jeep 
is  chosen  from  the  LR  Video  as  shown  in  Figure  3.  The  sampling  frequency 
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used  while  forming  the  original  digital  image  was  10  MHz.  Since  it  is 
desired  to  use  a -sampling  frequency  of  5 MHz,  every  other  column  is 
deleted  from  the  120  x 240  segment  and  the  resulting  120  x 120  video 
will  henceforth  be  called  ULRV.  ULRV  is  then  quantized  using  a line 
average  quantizer  described  by  Equations  1 and  2.  The  processed  binary 
form  of  ULRV,  PLRV,  is  of  size  120  x 110.  PLRV  and  PHRV  in  binary  form 
are  input  to  the  correlation  process  to  generate  the  correlation  sur- 
faces to  be  discussed  in  the  following  sections. 

3.  Correlation  Arrays  EED28.C0RJ3A32,  EED28.C0RJ3B32  and  EED28.C0RJ3C32 
EED28.C0RJ3A32  is  the  correlation  array  of  size  89  x 79  obtained 
by  correlating  the  32  x 32  reference  array  with  PLRV  of  size  120  x 110. 
The  first  four  highest  peaks  of  the  correlation  surface  and  their  co- 
ordinates in  PLRV  are  tabulated  in  Table  1.  The  average  value  of  the 
correlation  surface  excluding  the  7x7  array  centered  at  the  peak,  the 
standard  deviation  of  the  correlation  surface  excluding  the  7x7  array 
centered  at  the  peak  and  the  signal -to-noise  (S/N)  ratio  are  also  com- 
puted. The  S/N  ratio  is  defined  as 

c/N  s Correlation  Peak  - Correlation  Surface  Average 
' Correlation  Surface  Standard  Deviation  v 

Coordinates  of  the  expected  peak  in  the  correlation  surface  were 
calculated  by  visual  inspection  of  overstruck  images  of  RHRV  and  PLRV. 
Let  P^  be  a pixel  in  RHRV,  preferably  on  the  jeep,  and  P 2 be  the  pixel 
in  ULRV  corresponding  to  P-|  in  RHRV  which  was  located  by  inspection.  If 

P1  = RHRVdp  d}), 

P2  = ULRV(I2,  J2),  (5) 

and  REFV ( 1 , 1)  * PHRV ( 1^ , Lg) 
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then  after  quantization 

P,  = PHRV(I, , J,  - 10) 

111  (6) 

P2  = PLRV(I2,  02  - 10) 

Since  ULRV  and  RHRV  have  the  same  spatial  resolution,  the  relative 
position  of  the  highest  peak  with  respect  to  (I2,  J2  - TO)  in  PLRV  will 
be  the  same  as  the  relative  position  of  REFV  (1,1)  with  respect  to 
(I.j,  J.j  - 10)  in  PHRV.  Therefore,  the  highest  peak  is  expected  at 

[I2  - (I  - Kg),  J2  - 10  - (01  - 10  - L2)] 

(7) 

• [i2  - (It  - Kg).  J2 " (J1  " 4)] 

For  the  Scene  3, 

Ij  = 34,  J7  = 21 

I2  = 39,  J2  = 34  (8) 

l<2  * 18,  L2  * 13 

Substituting  8 into  7 reveals  that  the  peak  should  appear  at  [23,  26]. 
This  is  clearly  shown  in  Figure  4. 

EED28.C0RJ3B32  is  the  correlation  surface  of  size  41  x 36  obtained 
by  correlating  the  32  x 32  REFV  from  PHRV  with  PHRV  Itself.  Therefore 
the  peak  will  appear  at  (Kj,  Lg)  and  its  value  will  be  1024  since  auto- 
correlation yields  perfect  registration  at  the  peak.  Since  this  correla 
tlon  surface  is  used  to  generate  EED28.C0RJ3C32  and  has  no  other  signi- 
ficance, the  results  of  EED28. C0RJ3B32  are  not  tabulated.  However,  this 


correlation  surface,  its  peak  and  PHRV  are  shown  In  Figure  5a. 

| 


ULRV ( 1 ,1 ) = Point(75,157)  In  (240,512)  LR  array 
r~  PLRV(l.l) 


avg.  PC0RJ3B32 ( 1 ,1 ) 


Figure  5.  Arrays  and  expected  peak  in  (32  x 32)  autocorrelation. 
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EED28.C0RJ3C32  is  the  correlation  surface  obtained  by  correlating 
the  autocorrelation  surface  EED28.C0RJ3B32  with  EED28.C0RJ3A32.  Basically 
the  approach  Is  the  same  as  discussed  before.  The  REFV  chosen  from  the 
processed  C0RJ3B32  array  is  centered  a'jout  the  peak  In  the  correlation 
surface.  Since  the  array  C0RJ3B32  contains  only  26  columns  after  line 
average  quantization,  a REFV  of  size  32  x 26  Is  chosen  as  shown  In 
Figure  5a.  Figure  5b  shows  the  location  of  the  REFV  In  the  processed 
C0RJ3A32  array  and  the  coordinates  of  the  expected  peak  In  the  correla- 
tion surface  EED28.C0RJ3C32. 

The  same  result  can  be  achieved  by  calculation  as  follows.  The 
relative  position  of  the  expected  peak  In  EED28.C0RJ3C32  with  respect 
to  the  peak  at  (23,  25)  In  PC0RJ3A32  should  be  the  same  as  that  of  REFV 
(1,1)  with  respect  to  (18,  3)  in  the  processed  C0RJ3B32  array.  There- 
fore the  peak  In  EED28.C0RJ3C32  Is  expected  at 

[23  - (18  - 3),  16  - (3  - 1)]  » [8,  14] 

The  results  of  this  simulation  are  given  in  Table  1 at  end  of  chapter. 

Figures  6-8  Illustrate  the  generation  of  EED28.C0RJ3A16, 
EED28.C0RJ3B16  and  EED28.C0RJ3C16  using  a reference  array  of  size  16  x 16. 
The  results  of  simulation  are  tabulated  In  Table  2. 


B.  Correlation  Using  Analog  Preprocessing  Filter  as  Quantizer 
The  transfer  function  G(s)  of  the  analog  preprocessing  filter  is 
given  by  Equation  9. 


G(s) 
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Figure  6.  16  x 16  reference  array  in  processed  high  resolution  video. 


Figure  7.  Expected  correlation  peak  in  C0RJ3A16  array. 


Line  Avg.  Processed  C0RJ3A16(1 ,1 ) 


Figure  8.  16  x 16  autocorrelation  arrays  and  expected  peaks. 
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This  filter  has  zero  dc  gain  and  therefore  transforms  the  input  video 
to  zero  mean  video.  In  order  to  process  a digital  image,  the  analog 
filter  is  transformed  to  a digital  filter  by  bilinear  transformation  as 
explained  below. 

In  bilinear  transformation,  the  digital  transfer  function  H(z)  is 
obtained  from  analog  transfer  function  G(s)  by  the  substitution 
c 2 Z-l 

s t ■ z+r 


That  is 


where 


H(Z)  * G(s)L  _ 2 . Z-l 

■S  " T 2+T 

T = sampling  period. 


The  price  paid  for  this  is  the  introduction  of  a distortion  in  the 
frequency  axis. 

Equation  10  can  be  used  if  the  distortion  can  be  tolerated,  which 
is  generally  true  if  the  sampling  frequency  is  very  high  compared  to 
the  critical  frequencies  (W^ , Vl2  and  W3).  Otherwise,  if  the  critical 
frequencies  of  the  analog  filter  are  prewarped  as  shown  by  Equations 
10a,  10b,  10c,  then,  when  the  analog  filter  is  transformed  to  a digital 
filter  using  Equation  lOd,  the  digital  filter  will  meet  the  desired 


specifications. 


W T 

W]  a tan(-p) 

W T 

W2  = tan(-|-) 

W T 

W3  * tan  (-§-') 

H(Z)  = G'  (s)  s . Z£L 
5 Z+l 


(10a) 


(10b) 


(10c) 


(10d) 
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Therefore,  G(s)  in  Equation  9 can  be  written  as 
G(s) 


2.21  S2 


s3  + (W^  + W£  + W^)S2  + (W’W£  + W'W^  + W. 


I 

r 


i 1 1 

• : 

• i 

ii 


From  Equation  lOd, 
H(Z)  « - 


2.21  U‘  (M)‘ 


3 T 

(p|)  + (W{  + *2  + w3>(fif)  + (“iw2  * 1 


+ W'WJW' 


Letting  A = (W]  + W£  + W^) 

B = (W'W'  + + W^W') 


C * 

d = 2.2i  w: 


one  obtains 

H(Z) 


D(fer} 

(2?|)3  + + B(^}  + C 


lZ+l ' °VZ+1 

Simplifying  the  above  equation  yields 


h(z)  • -4 

L. 


a(Z3  - Z2  - Z + 1) 


b^Z  + b2Zc  + b3Z  + 1 


where,  a s D/(A  - B + C - 1) 

b1  * (A  + B + C + 1 )/ (A  - B + C - 1) 
b2  * (-A  + B + 3C  - 3)/(A  - B + C - 1) 


3Wi>s  * W3 

(11) 


'2W3  + W3Wi)<pf) 

(12) 

(13) 


(H) 

(15) 

(16) 


b3  - (-A  - B + 3C  + 3)/(A  - B + C - 1) 


' ? £ 
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But  H(Z)  = 0?) 

where,  Y(Z)  is  the  Z-transform  of  the  output  sequence  { Y(rj) > and 
X(Z)  is  the  Z-transform  of  the  input  sequence  {X(n)> 

From  Equations  15  through  17, 


Cross  multiplying  both  sides  of  Equation  18  yields 

(b^Z3  + b2Z2  + b3Z  + l)Y(Z)  = a (Z3  - Z2  - Z + l)X(Z)  (19) 

Taking  the  inverse  Z-transform  of  Equation  19  yields 

y(n)  = a[x(n)  - x(n-l)  - x(n-2)  + x(n-3)]/b1 

-[b2  y(n-l)  + b3  y(n-2)  + yU-3)]/^  (20) 

Equation  20,  where  the  constants  are  described  by  Equation  16, 
describing  the  digitized  analog  preprocessing  filter  and  can  be  easily 
simulated  on  digital  computers. 

1.  Quantization  of  RHRV 

The  coefficients  a,  b-j,  b2  and  b3  of  the  difference  equation  de- 
scribed by  Equation  16  are  computed,  assuming 

W]  * 984ir 

W2  = 1100278ir 

(21) 

W3  * 58062tt 

T = 0.2  x 10‘6  sec. 

NR  * Number  of  rows  in  RHRV 
NC  * Number  of  columns  in  RHRV 
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An  input  sequence  (x(n)}  of  length  NR  • NC  is  formed  by  joining 


the  successive  rows  of  RHRV.  The  first  three  elements  of  the  output 


sequence  {y(n)>  are  initialized  to  zero.  Then,  all  other  elements 


of  {y(n)>  are  computed  using  Equation  20.  The  first  NC  elements 


of  the  output  sequence  (y (n) > form  the  first  row  of  the  zero  mean 


video  (ZMV),  and  the  second  NC  elements  of  (y (n) } form  the  second  row 


of  ZMV,  etc.  Equation  22  describes  the  quantization  process  of  the 


zero  mean  video  to  obtain  PHRV,  the  binary  form  of  RHRV. 


puR w/r  n ^ ZMV(I.J)  > DELTA 

HHRVU.JJ  - 0 # If  ZMV(I.J)  < DELTA 


where,  DELTA  is  the  quantization  threshold  which  yields  approximately 


an  equal  number  of  zeros  and  ones  in  REFV.  Its  value  is  determined  by 


simulation. 


The  method  of  choosing  the  reference  array  from  RHftV  was  discussed 


in  a previous  section.  For  Scene  3,  RHRV,  PHRV  and  reference  arrays  of 


size  32  x 32,  16  x 16  and  8x8  are  shown  in  Figure  9. 


2.  Quantization  of  ULRV 


The  quantization  process  of  ULRV  is  identical  to  that  of  RHRV  with 


the  following  two  changes. 


a.  The  coefficients  a,  b. , b0  and  b,  are  computed,  assuming 


W]  = 984ir 


W2  » 1 1 00278-rr 


W3  = 174052tt 


0.2  x 10”°  sec. 


RHRV  (1,1) 
PHRV ( 1 ,1 ) 


Figure  9.  8 x 8,  16  x 16  and  32  x 32  reference  arrays  in  RHRV  and  PHRV. 


i 


b. 
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The  quantization  process  of  zero  mean  video  to  obtain  PLRV, 
the  binary  form  of  ULRV,  is  modified  as  in  Equation  24. 


i 


PLRV(I,J)  = { 


1 , If  ZMV(I.J)  > 0 
0 , If  ZMV(IfJ)  < 0 


(24) 


3.  Correlation  Array's  EED28.C0RJ3D32,  EED28.C0RJ3E32  and  EED28.C0RJ3F32 


EED28.C0RJ3D32  is  the  correlation  array  of  size  89  x 89  obtained 
by  correlating  a REFV  of  size  32  x 32  with  PLRV  of  size  120  x 120.  The 
first  four  highest  peaks  and  their  coordinates  are  tabulated  in  Table 
1.  The  average  value  of  the  correlation  surface  excluding  the  7x7 
array  centered  at  the  peak,  the  standard  deviation  of  the  correlation 
surface  excluding  the  7x7  array  centered  at  the  peak  and  the  signal- 
to-noise  ratio  are  also  computed. 

The  methods  of  calculating  the  coordinates  of  the  expected  peak 
is  similar  to  that  discussed  in  Section  A and  the  expected  peak  is 
shown  in  Figure  10.  EED28.C0RJ3E32  is  the  correlation  surface  of  size 
41  x 46  obtained  by  correlating  a 32  x 32  REFV  with  PHRV.  This  correla- 
tion surface  and  its  peak  in  PHRV  are  shown  in  Figure  11(a). 

EED28.C0RJ3F32  is  the  correlation  surface  obtained  by  correlating 
the  correlation  surface  EED28.C0RJ3D32  with  the  reference  array  from 
the  correlation  surface  EED28.C0RJ3E32.  The  method  of  choosing  the 
REFV  from  EED28.C0RJ3E32  Is  the  same  as  that  discussed  in  Section  A 
and  Is  clearly  indicated  in  Figures  11(a)  and  11(b).  Figures  12  and  13 
illustrate  the  generation  of  EED28.C0RJ3D16,  EED28.C0RJ3E16  and 
EED28.C0RJ3F16.  Simulation  results  are  tabulated  in  Table  2. 


I 


Figure  11.  32  x 32  autocorrelation  arrays  and  expected  peaks. 


(1,1)  in  quantized  corr. 
surface 


C0RJ3D16  (105,105) 


_ PC0RJ3E16  (1,1) 


Figure  13.  16x16  autocorrelation  arrays  and  expected  peaks. 
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C.  Correlation  Using  Array  Average  Quantizer 

Consider  the  layout  of  the  input  video  array  as  given  in  Figure 

14.  The  pixel  to  be  quantized  is  located  in  the  center  of  a K x L 

subarray  of  pixel  values.  The  average  value  used  for  the  threshold 

is  based  on  the  average  value  of  the  K x L pixel  subarray.  Equation 

(25)  details  the  average  value  calculation. 

K L 

X(i,  j)  = ^ £ L X(i  - k - 1 + I.  j - l - 1 + J)  (25) 
1=1  J=1 

where  k = largest  integer  <_  K/2 
l = largest  integer  _<  1/2 


Equation  (26)  gives  the  quantization  process 


xq(1.  j)  - (J 


i X(1,  j)  iX(1,  j) 
; X(i,  j)  < X(i,  j) 


(26) 


Because  there  is  a border  region  of  the  input  array  which  will  be 
quantized  incorrectly,  the  resulting  quantized  array  has 
(N  - K + 1)  x (M  - L + 1)  pixels.  The  rest  of  the  procedure  is  similar 
to  that  using  the  line  average  quantizer.  EED28.C0RJ3G32  is  the  correla- 
tion array  of  size  79  x 79  obtained  by  correlating  REFV  of  size  32  x 32 


with  PLRV  of  size  110  x 110. 


EED28.C0RJ3H32  is  the  correlation  surface  obtained  by  correlating 
the  32  x 32  REFV  from  PHRV  with  PHRV  itself.  EED28.C0RJ3I32  is  the 
correlation  surface  obtained  by  correlating  the  correlation  surface 
EED28.C0RJ3G32  with  EED28.C0RJ3H32.  A similar  analysis  is  done  for  a 
reference  array  of  size  16  x 16.  Details  are  clearly  shown  in  Figures 
15  - 19. 


Pixel  X (1,j) 


Figure  14.  Layout  of  the  input  array  for  quantization  based  on 
an  array  quantizer. 


RHRV  (1,1) 


32  reference  arrays  in  RHRV  and  PHRV 


inj  quantized  corr  surface 


Expected 


Figure  17.  32x32  autocorrelation  array  and  expected  peaks. 


Expected  peak  In  C0RJ3G16  array. 


37  - 


Tables  3 through  16  give  the  results  of  simulations  for  seven 
additional  scenes.  A total  of  eight  scenes  was  used  in  order  to  ob- 
tain data  for  a variety  of  different  backgrounds.  In  obtaining  the 
original  eight  scenes,  an  effort  was  made  to  include  backgrounds  with 
high  spatial  frequency  content  and  with  low  spatial  frequency  content 
and  to  include  scenes  with  both  high  and  low  contrast  ratios. 

Table  17  is  a description  of  all  scenes  used  and  Table  18  is  a 
listing  of  all  correlation  surfaces  with  their  description. 


38  - 


D.  Cross  Sectional  Plots  of  Correlation  Surfaces 

In  order  to  examine  qualitatively  the  size  and  shape  of  the  corre- 
lation surfaces  around  the  true  peaks  and  false  peaks,  the  following 
cross  sectional  plots  were  obtained  for  two  scenes  (parking  lot  and 
jeep  in  front  of  the  fence).  Figures  included  in  this  section  are 
the  cross  sectional  plots  of  the  correlation  surface  EED28.C0RJ3G32 
for  the  jeep  in  front  of  the  fence  scene.  In  the  figures  (IMAX,  JMAX) 
is  the  location  of  the  first  peak  in  the  correlation  surface  and 
(IMAX1,  JMAX1)  is  the  location  of  the  second  highest  peak  in  the 
correlation  surface. 

Figure  20  shows  the  cross-sectional  plots  through  (IMAX,  JMAX) 
of  the  correlation  surface.  Figures  21  and  22  are  the  cross  sectional 
plots  through  (IMAX-2,  JMAX-2)  and  (IMAX+2,  JMAX+2).  Similarly, 

Figures  23  - 26  show  the  cross  sectional  plots  through  (IMAX1,  JMAX1) 
(IMAX1-2,  JMAX1-2)  and  (IMAX1+2,  JMAX1+2),  respectively.  Plots  of 
third  and  fourth  highest  peaks  are  not  included.  Similar  plots  for 
other  correlation  surfaces  listed  in  Table  1 and  Table  2 of  the  pre- 
vious section  were  obtained  but  are  not  included  in  this  report. 

t' 

I , 

ii  i 


20.00 


60.00 


60.00 


100.00 


40.00 

I-flXIS 


J-flXIS 


Figure  25.  Cross  sectional  plots  through 
(IMAX1+2,  JMAX1+2) . 


Table  1.  Scene  3 - Jeep  in  front  of  the  fence,  32  x 32  reference  array. 


EED28.C0RJ3I32  ( 6,  14)  ( 6,  15)  270.156  89.917  2.512  (18,  7)  (25,  27) 


EED28. C0RJ3I16  (15,  15)  (16,  18)  128.414  30.203  2.867 


Table  3.  Scene  4 - Jeep  behind  the  fence,  32  x 32  reference  array. 


498  486  485  483 

EED28.C0RJ2132  (11.  19)  (11,  20)  273.488  106.149  2.115  (12,  35)  (24,  39)  (23,  32) 


Woods  scene,  32  x 32  reference  array. 


</> 

<U 
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273.578  53.965  3.141 


Table  10.  Woods  scene,  16  x 16  reference  array. 
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Table  13.  Rock  quarry,  32  x 32  reference  array. 
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EED28.C0RRQI32  (12,  33)  (12,  33)  272.379  34.640  3.222  (19,  20)  (30,  40)  (25,  32) 


Table  17.  Description  of  scenes. 


EED28.C0RNTXXX  - NASA  tower. 


CORWTXXX  - Water  tower. 


CORWDXXX  - Woods . 


C0RR4XXX  - Parking  lot. 


CORRQXXX  - Rock  quarry. 


C0RJ2XXX  - Jeep  in  the  parking  lot. 


C0RJ3XXX  - Jeep  in  front  of  the  fence. 


C0RJ4XXX  - Jeep  behind  the  fence. 
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Table  18.  Description  of  correlation  surfaces. 


EED28.C0RXXA32  - Cross  correlation  of  PLRV  with  REFV  of  size 
32  x 32  from  PHRV  using  digital  line  average 
quantizer. 

B32  - Autocorrelation  of  PHRV  with  REFV  of  size 
32  x 32  from  PHRV  itself  using  digital  line 
average  quantizer. 

C32  - Correlation  of  the  correlation  surface  A with 
REFV  of  size  32  x 26  from  correlation  surface 
B using  digital  line  average  quantizer. 

D32  - Cross  Correlation  of  PLRV  with  REFV  of  size 

32  x 32  from  PHRV  using  analog  filter  quantizer. 

E32  - Autocorrelation  of  PHRV  with  REFV  of  size 

32  x 32  from  PHRV  itself  using  analog  filter 
quantizer. 

F32  Correlation  of  correlation  surface  D with  REFV 
of  size  32  x 32  from  correlation  surface  E using 
analog  filter  quantizer. 


G32  - Cross  correlation  of  PLRV  with  REFV  of  size 

32  x 32  from  PHRV  using  area  average  quantizer. 

H32  - Autocorrelation  of  PHRV  with  REFV  of  size 
32  x 32  from  PHRV  itself  using  area  average 
quantizer. 

132  - Correlation  of  correlation  surface  G with  REFV 
of  size  21  x 26  from  correlation  surface  H using 
area  average  quantizer. 


Table  18. 


Description  of  correlation  surfaces. 


A16  - Gross  correlation  of  PLRV  with  REFV  of  size  16  x 16 
from  PHRV  using  digital  line  average  quantizer. 

B16  - Autocorrelation  of  PHRV  with  REFV  of  size  16  x 16 
from  PHRV  itself  using  digital  line  average 
quantizer. 

Cl 6 - Correlation  of  the  correlation  surface  A with  REFV 
of  size  16  x 16  from  correlation  surface  B using 
digital  line  average  quantizer. 

D16  - Cross  correlation  of  PLRV  with  REFV  of  size 

16  x 16  from  PHRV  using  analog  filter  quantizer. 

El 6 - Autocorrelation  of  PHRV  with  REFV  of  size  16  x 16 
from  PHRV  itself  using  analog  filter  quantizer. 

FI 6 - Correlation  of  correlation  surface  D with  REFV  of 
size  16  x 16  from  correlation  surface  E using 
analog  filter  quantizer. 

G16  - Cross  correlation  of  PLRV  with  REFV  of  size 

16  x 16  from  PHRV  using  area  average  quantizer. 

HI 6 - Autocorrelation  of  PHRV  with  REFV  of  size  16  x 16 
from  PHRV  itself  using  area  average  quantizer. 

116  - Correlation  of  correlation  surface  G with  REFV  of 
size  16  x 16  from  correlation  surface  H using  area 
average  quantizer. 
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3.  CONCLUSIONS 

In  this  chapter,  the  relative  performance  of  the  three  quantizers 
based  on  the  simulation  results  of  the  eight  different  scenes  listed 
in  the  previous  chapter  are  presented. 

1.  It  was  mentioned  earlier  that  an  equal  number  of  'zeros'  and 
'ones'  in  the  REP/  is  essential  for  better  correlation  results.  It 
was  found  that  the  area  average  quantizer  needs  fewer  iterations  to 
yield  an  equal  number  of  zeros  and  ones  in  REFV  when  compared  to  the 
line  average  quantizer  and  the  analog  filter  quantizer  for  a given  scene. 
The  analog  filter  quantizer  needs  a significantly  larger  number  of 
iterations  when  compared  to  the  other  two  quantizers. 

2.  The  area  average  quantizer  identifies  the  true  location  of  the 
target  in  all  eight  scenes  for  a REFV  of  size  32  x 32  as  well  as  16  x 16. 
The  line  average  quantizer  identifies  the  true  location  of  the  target 

in  all  eight  scenes  for  REFV  of  size  32  x 32;  but  when  REFV  of  size 
16  x 16  Is  used  it  identifies  the  target  for  only  six  of  the  eight 
scenes.  However,  the  true  peak  appears  as  the  second  highest  peak  in 
the  correlation  surfaces  for  the  other  two  scenes.  When  the  analog 
filter  quantizer  is  used  with  REFV  of  size  32  x 32,  the  true  location  of 
the  target  is  identified  in  six  scenes  and  the  true  peak  appears  as  the 
second  highest  peak  in  the  correlation  surface  for  one  of  the  other  scenes. 
When  a REFV  of  size  16  x 16  is  used,  the  target  was  correctly  identified 
in  only  two  of  the  eight  scenes.  In  two  more  scenes  the  true  peak 
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appears  as  the  second  highest  peak  in  the  correlation  surfaces.  The 
target  was  not  found  in  the  remaining  four  scenes.  This  clearly 
shows  the  superiority  of  the  area  average  quantizer  over  the  other  two 
quantizers. 

3.  In  most  of  the  correlation  surfaces. 


(S/N  ratio)^  ^ > (S/N  ratio)Une  ayg>  > (S/N  rat1o)Ana,og 

f i 1 ter 

4.  The  correlation  surfaces  labeled  C in  Tables  1 - 16  were  ob- 
tained by  correlating  a reference  array  obtained  from  the  B surface 
with  the  A surface.  The  B surfaces,  which  are  not  included  in  Tables 
1 - 16,  were  obtained  by  correlating  a 32  x 32  or  16  x 16  reference 
from  the  processed,  high  resolution  video  (PHRV)  with  the  PHRV,  yielding 
a quasi -autocorrelation  surface.  The  idea  being  that  if  the  processed 
HR  video  and  processed  LR  video  are  close  to  being  identical  (i.e.,  the 
ideal  case)  then  autocorrelation  of  a reference  taken  out  of  PHRV  with 
the  PHRV  should  yield  a correlation  surface  very  close  to  the  cross- 
correlation of  the  PHRV  with  PLRV.  Then  by  choosing  a reference  from 
surface  B centered  about  the  autocorrelation  peak  and  correlating  with 
surface  A,  one  should  obtain  the  location  of  the  true  peak  in  A even  if 
it  is  not  the  highest  peak  in  the  surface. 

The  above  approach  was  motivated  by  the  need  to  establish  some 
criterion,  based  on  the  shape  of  the  correlation  surface  about  the  peak, 
for  picking  out  the  true  correlation  peak  in  a correlation  surface  even 
though  it  may  not  be  the  highest  peak.  Upon  observing  many  correlation 
surfaces,  this  author  came  to  the  conclusion  that  the  shape  of  the 
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correlation  surface  about  the  true  peak  is  quite  different  for  various 
scenes  and  therefore  cannot  be  characterized  very  well  by  one  or  more 
surface  shape  criteria. 

Similarly,  surfaces  F and  I in  Tables  1 - 16  were  obtained  by 
taking  the  reference  from  surfaces  E and  H and  correlating  with  sur- 
faces D and  G,  respectively. 

From  Tables  1 - 16  it  is  clear  that  this  approach  did  not  yield 
very  good  results.  Examination  of  the  correlation  surfaces  in  Figure 
20  through  25  and  numerous  others  which  were  generated,  revealed  that 
quite  often  the  correlation  surface  about  a false  peak  is  quite  similar 
to  the  shape  of  the  surface  about  the  true  peak  when  quantized  to  only 
two  levels.  In  these  cases,  correlation  of  the  correlation  surfaces 
does  not  yield  meaningful  results.  Techniques  such  as  normalization 
of  the  correlation  surfaces,  offsetting  the  value  used  in  the  two-level 
quantization,  non-equal  number  of  ones  and  zeros,  etc.,  were  tried, 
none  of  which  improved  the  results  significantly. 

From  the  above  it  was  concluded  that  correlation  of  the  correlation 
surfaces  is  not  useful  in  determining  the  true  correlation  peak.  From 
the  results  obtained  in  the  simulations,  it  is  questionable  whether 
any  set  of  criteria,  based  on  the  expected  shape  of  the  correlation 
surface  about  a true  peak,  can  be  specified  which  will  yield  good  re- 
sults for  all  scenes. 

5.  Table  19  was  obtained  by  computing  the  ratio  of  the  correlation 
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peak  to  the  second  highest  peak  for  the  A,  D and  G correlation  surfaces 
in  Tables  1 - 16.  The  astericks  indicate  the  cases  where  false 
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correlation  occurred.  The  digital  area  average  (G)  correlated  correctly 
in  all  sixteen  cases;  the  digital  line  average  (A)  correlated  correctly 
in  all  but  two  cases  (both  were  using  16  x 16  reference  arrays);  and 
the  analog  line  averager  (D)  correlated  correctly  in  9 or  the  16  cases. 
The  digital  area  average  had  the  highest  peak  to  second  peak  ratio  in 
10  of  the  16  cases  and  the  digital  line  average  in  6 of  the  16  cases. 

6.  The  average  values  of  the  correlation  surfaces  were  fairly  close 
to  being  the  same  in  all  cases.  It  is  noted  that  the  digital  line  and 
digital  area  average  were  usually  the  closest  in  value.  The  same  is 
true  of  the  correlation  surface  standard  deviation. 
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Table  19.  Ratio  of  correlation  peak  to  second  highest  peak. 


Table 

Number 

A 

D 

G 

1 

1.165 

1.036 

1.158 

2 

1.073 

1.016* 

1.088 

3 

1.143 

1.021* 

1.141 

4 

1.061 

1.043 

1.047 

5 

1.181 

1.113 

1.124 

6 

1.079 

1.029 

1.104 

7 

1.054 

1.014* 

1.118 

8 

1.010* 

1.030* 

1.08 

9 

1.130 

1.080 

1.223 

10 

1.016* 

1.027* 

1.048 

11 

1.098 

1.025 

1.150 

12 

1.072 

1.026 

1.011 

13 

1.136 

1.052 

1.191 

14 

1.018 

1.012* 

1.046 

15 

1.198 

1.143 

1.157 

16 

1.051 

1.020* 

1.064 

E'm 


